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PREFACE 



The purpose of this monograph is to acquaint classroom 
teachers with the Proficiency Guidelines of the American 
Council on the Teaching of Foreign Languages (ACTFL), 
publisher of Foreign Language Annals , a Journal for foreign 
and second language educators. The Proficiency Guidelines are 
to be used in assessing the oral language proficiency of 
students in foreign language and second language programs by 
means of the oral interview technique. 

Designated pages in this monograph are to be used as a 
pull out manual for illustrating how informal oral language 
proficiency assessment interviews are conducted. The oral 
language proficiency assessment (OLPA) manual, which is 
comprised of the several yellow pages, may be used by the 
interviewer before and after interviews. Although special 
training is required to conduct formal interviews, a 
familiarization with the ACTFL guidelines and the oral 
interview technique can aid classroom teachers and others in 
informally assessing students' speaking ability. 

The authors are grateful to David Hiple and the American 
Council on the Teaching of Foreign Languages for granting 
permission to use the guidelines and information from the 
Education al Testing Service (ETS) Oral Proficiency Testing 
Manual . 
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I. INTRODUCTION 

Need for oral language proficiency assessment (OLPA) 

There has been an Increasing emphasis In recent years on 
the importance of teaching and evaluating oral proficiency 
skills In all foreign and second language programs. 
Traditional foreign language programs for students whose first 
language was English Included listening comprehension, 
reading, writing, speaking, and culture. Yet historically in 
the United States students have not left these programs as 
fluent speakers of the target language. Many teachers and 
students sought ways to Include more real life situations as 
part of classroom work and extracurricular activities whereby 
the spoken language could be nurtured and developed. 
Political, social, and technological changes in the last 30 
years have contributed to the need to produce graduates who 
could not only understand these changes and implement new 
ideas, but who could also communicate effectively in languages 
other than English. Research has established that there is a 
relationship between an individual's ability to communicate 
and that person's ability to function in a society. 

In addition, as more and more limited English proficient 
students were identified in communities all across America, 
the educational system accepted the task of providing these 
students with an education through various types of second 
language programs such as bilingual and English as a Second 
Language (ESL) and English to Speakers of Other Languages 
(ESOL) programs. The immediacy of accommodating large numbers 
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of limited English proficient students meant more than 
measuring students' language ability and achievement by 
traditional means of paper and pencil tests. It was necessary 
that students speak the language. Educators had to provide 
experiences through which effective speaking would occur and 
also be able to measure students' progress for placement 
purposes. It was necessary to insure not only that oral 
communication was taking place, but that it was also the 
vehicle by which students were learning the cognitive and 
affective skills to progress in school settings. Teachers 
need to know thei" students' oral second language proficiency 
skills, then, as a vital indicator of students' current and 
future progress in school. 

Proficiency based teaching and learning ^re now receiving 
greater attention. Several research findings have important 
implications for proficiency-based language curricula and 
instruction (Van Patten, 1986). 

For succe ssful language acquisition . learners need 
access to inpu t which is communicatively or meaningfully 
oriented. According to Krashen's (1982) Monitor Theory, 
children and adults acquire language over time simply by being 
exposed to meaningful, comprehensible input. Krashen claims 
that the conscious teaching of grammar has dubious value. He 
claims that many language classies are input-poor environments 
where learners have little opportunity to speak with 
conversational partners who are native speakers and who are 

O 
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also trained in ways to provide comprehensible input at 
appropriate levels • 

2r Learners of a given second language tend to pass 
through certain transitional stages of grammatical 
competence > These stages include negation, WH-question 
formation, WH-embedding and morphological phenomena such as 
plural formation, reflexives, and present tense inflection. 
Thfe stages suggest certain universal tendencies in how 
particular constructions are acquired over time. The 
implication of this finding is that teachers need to be aware 
that students are equipped with certain internal processing 
mechanisms that organize language independently of overt 
instruction. Van Patten (1986) suggests that teachers let 
these stages run their course without undue emphasis on direct 
grammar instruction particularly with beginning second 
language students. Making students aware of this natural 
process also makes them more comfortable as they attempt to 
speak. 

3» Improvement in linguistic accuracy and overall 
proficiency is more a result of motivation and other affective 
factors in the learner rather than other factors . Language 
teachers are aware that the lack of a second language social 
group influences language learning and that social interaction 
affects motivation. Motivation is affected when the second 
language holds particular status, positive or negative, in the 
minds of the learners. Teachers should not expect miracles 
from contrived social settings but must be aware that students 
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may acquire more second language in interactions with others 
than in traditional grammar oriented classrooms. 

^' Direct e'-ror correct ion bv the instructor does not 
promote linguistic accuracy and the absence of error 
correction in the early stages of acquisition does not Imoede 
the development of linfi;uistlc acnurar.y. This is a provocative 
finding for language teachers and one that is debated by 
teachers, students, and researchers alike. Van Patten (1986) 
maintains that those who adhere to overt correction of errors 
may be responding to the pressure of getting ironRdiate 
results, a necessary pressure imposed by the way our 
-iducational systems are set up. Much of aducatlon demands 
that teachers proceed along easily charted pa.ths, document 
progress, and outline behavioral objectives. Teachers are 
often Judged by their ability to impart information and 
measure that information in their students and be 
accountable. In this approach, error correction is one way to 
ensure that we are doing our Job. It does not always 
correlate, however, with what a student actually knows and 
does With language. This is not to say that pointing out 
errors, particularly those that inhibit communication, is not 
warranted. It is to say, however, that overt correction of 
errors is not a necessary requirement for beginning language 
learners . 

5. Teachers must have a high sense of efficacy , in 
order to implement the research findings cited above, it is 
necessary to have facilitative teaching/learning environments 



and teachers who believe they can teach and reach any child In 
such environments. Teachers* sense of efficacy, which refers 
to teachers' judgment of their capability to perform In their 
teaching situations, has been lowered In recent years by many 
factors such as lack of administrative support, poor working 
conditions, low salary, and societal changes (Ashton & V/ebb, 
1986; McNeely, 1985). Other factors such as too many 
students, too many preparations, and too many administrative 
requirements, have contributed to low teacher morale and job 
dissatisfaction. It follows that teachers whose professional 
efforts are thwarted may begin to lessen their expectations of 
themselves and their students. Helpful teaching/evaluating 
tools and materials contribute to high teacher sense of 
efficacy. The following is a description of one such tool 
developed specifically for second language teachers. 
The ACTFL/ETS oral interview technique 

The oral interview technique proposed by the Educational 
Testing Service (ETS) and the American Council on the Teaching 
of Foreign Languages (ACTFL) is a test of an individual's 
second language speaking ability that offers second language 
classroom teachers a means by which oral proficiency skills 
may be evaluated ( Educational Testing Service Oral Proficiency 
Testing Manual . 1982). It is a 10- to 30-minute, face to face 
conversation that results in a notable speech sample based on 
specific guidelines and is a test of functional language 
ability, not a discrete-point test of knowledge about the 
language. The complete ACTFL Proficiency Guidelines, located 
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in Appendix I, offer both a conceptual framework and a 
professional vocabulary to help toward teaching for 
proficiency and provide the organizing principle in second 
language teaching (Higgs, 1985). 

Proficiency levels or ranges of skill were determined by 
research and experienced based techniques and with practice 
teachers can master the bas^c components of each level and are 
able to conduct the interview as a spontaneous, informal 
conversation. Other instruments do exist for assessing oral 
language proficiency skills. A brief description of some of 
these currently in use is located in Appendix II. Part II of 
this discussion of the ACTFL/ETS oral interview technique 
provides a complete description of the speaking proficiency 
levels and rating scales, and Part III describes the interview 
process itself. Part IV discusses pertinent information 
relative to school age limited English proficient students 
that is important for second language oral proficiency 
assessment. 

His-corv of ora l language proficiency testing 

During World War II foreign language capability became a 
pressing national concern and language training was 
intensified in the U.S. at such sites as the Army Language 
School in California ( ETS OP Testing Manual . 1982). This 
training for functional language proficiency continued after 
the war primarily in government agencies to prepare personnel 
for foreign service positions worldwide. Linguists at the 
Foreign Service Institute (FSI) Language School developed a 
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rating scale to describe speaking ability and formulated an 
interview based evaluation procedure for rating oral language 
proficiency. The interview and rating guidelines were devised 
to be independent of any program of studies. This scale was 
adopted by other major agencies such as the Central 
Intelligence Agency. 

In 1955 the FSI developed an oral proficiency rating 
scale that extends from Level 0 (for no practical proficiency) 
to Level 5 (for performance equivalent to that of an educated 
native speaker) (ENS) (Buck & Hiple, 1984). The scale, shown on 
page 8, also includes plus levels for a total of eleven 
different ranges of skill. Known as the Interagency Language 
Roundtable (ILR) definitions, the scale is now the standard 
for language proficiency ratings in government agencies. 

In the 1960s, Educational Testing Service (ETS) personnel 
were trained by FSI to use the oral interview, and the U.S. 
State Department contracted ETS to train oral proficiency 
testers for the Peace Corps. For 20 years ETS has conducted 
tester training programs and has overseen the testing of 
thousands of volunteers in more than 60 languages 
(Liskin-Gasparro, 1984e). 

In 1979 the ETS received funding from the Department of 
Education to investigate the establishment of a common 
yardstick of performance standards that could be used in 
academic environments (Buck & Hiple, 1984). It was decided 
that a modified form of the 0 to 5 government scale would be 
useful in school settings. 



ILR Scale 



5 

native or bilingual proficiency 



4+ 



4 

distinguished proficiency 



3+ 



3 

professional proficiency 



2* 



2 

limitad working proficiency 

I 



1* 



1 

elementary proficiency 



0+ 



0 

no practical proficiency 
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Application of the oral interview procedure was extended 
in the early 1970s to the municipal and state levels and 
bilingual education and E3L/ES0L programs were initiated with 
teachers being trained specifically for these programs. 
Several states, including Florida, have enacted an oral 
proficiency requirement for the certification of bilingual 
education teachers* In addition, religious and business 
organizations have also used facets of the oral interview 
procedure to train missionaries and representatives 
respectively. In recent years there has been a major thrust 
in government, academic, and business circles toward oral 
proficiency in second language programs. This has required 
revamping curricula, materials, and evaluation. 

The ACTFL Proficiency Guidelines, developed with funding 
from the U.S. Department of Education, consist of descriptions 
of proficiency levels not only in oral skills but also in 
listening, reaciing, writing, and culture (Liskin-Gasparro, 
1984a). The guidelines were developed in part as a response 
to a recommendation of the President's Commission on Foreign 
Language and International Studies (1979) report to establish 
language proficiency achievement goals with special attenizion 
to speaking proficiency. This report, while addressing what 
it described as America s isolationist moat mentality, had 
important implications for all second language programs. The 
nation's responsibilities and opportunities as a major world 
power me idated the necessity to encourage and support 
functional knowledge of other languages and cultures. 
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InpUcit in such a mandate Is the necessity to offer 
methodologies to impart this knowledge and assess the impact 
on students' ability to function. This second language 
concept applies not only to the teaching of foreign languages 
but also to the teaching of English to nonnative speakers of 
English. 

Terms and definitions 

The need for specific guidelines for oral language 
proficiency assessment also brought about organizing 
principles that led to common acronyms and definitions that 
all practitioners might use in order to communicate in the 
same professional language. Research and literature in second 
language teaching and learning continue to wrestle with basic 
definitions for such concepts as bilingualism and oral 
proficiency. The oral interview procedures as proposed by the 
ACTFL guidelines also include working vocabulary that teachers 
and researchers alike may use to avoid confusion. It is 
important in oral interview technique, for instance, to have a 
common understanding of the difference between achievement 
testing and proficiency testing. Achievement testing is 
anchored to a particular curriculum or program of stuay. 
Proficiency testing is testing language competence that 
indicates general knowledge and life experience, not 
necessarily related to instruction (Buck and Hiple, 1984). 

It is also important to define foreign language education 
and second language education. Foreign language education is 
teaching a language that is not native to the students and 
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providing instruction within a social and geographical 
environment where tne target language is not the predominant 
language (Jaeger, 1985). Second language education is 
teaching a language that Is not native to the students and 
providing instruction within a social and geographical 
environment where the target language is the predominant 
language (Jaeger, 1985). 

The value of proficiency tests is that they measure real- 
life language ability to survive not only in classrooms "^xiz 
also in the world. Proficiency testing is not discrete point 
testing, that is, testing the separate skills that make up a 
person's total language competence. These and other terms and 
definitions used in this moncgraph are taken from the ETS Oral 
Proficiency Testing Manual and from other sources. 
Caveats and Questions 

The provisional nature of the ACTFL Proficiency 
Guidelines, while offering common terminology and assessment 
standards, carries with it the need for further discussion and 
refinement. Implications must be con'^'dered for how these 
guidelines can realistically be used in classrooms and what 
changes made in curriculum and instruction materials. The 
proficiency guidelines are intended to offer a focus not a 
methodology and in order to implement an increased focus 
toward oral communication, existing practices, curricula, and 
materials must be adapted. In these beginning stages the need 
exists for classroom teachers to have strategies to emphasize 
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real life language based on texts and materials they currently 
use . 

Most importantly, the elements of time, place, and 
support must be accommodated. Genuine dialog between student 
and teacher is a time intensive activity. In overcrowded, 
multilevel, multilanguage classes thera is often not enough 
time to spend with each child in meaningful conversation. 
This time is essential when a large part of the instructional 
goal is to assist students in realizing the importance of and 
gaining confidence in their abilities. 

A suitable place to conduct meaningful language teaching, 
learning, and assessment is also essential yet often 
unavailable to second language teachers in particular. Many 
teachers are itinerants, that is, they travel from place to 
place, both within a school and among many schools and school 
districts. The actual physical location of language learning 
activities is an important and often overlooked accommodation 
due in part to the pull out nature of many programs and the 
lack of permanency associated with these programs. 

Support is essential, not only in terms of 
administrative, collegial, and parental aid, but also in terms 
of resources and materials. Sound pedagogy rests on the 
inclusion of support personnel in the classroom as well, 
people who are themselves vehicles through which students may 
practice and refine their oral communication skills to assist 
classroom teachers in meeting the goals they know they can 
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reach when provided with the three essential elements of time, 
place^ and support. 

Questions to be answered include those asked by Schulz 
(1986) and Lantolf & Frawley (1985): 



1* What changes will have to be made in order to make 
this major switch from a grammar-based achievement 
syllabus to one based on proficiency? 

2. How realistic is it to expect that the guidelines can 
be Implemented under the limitations of current 
instructional settings? 

3. How can subjective biases of the interviewer be 
overcome? 

4. What techniques help to overcome the obstacle of 
obtaining an effective language sample from a shy or 
unmotivated student? 

5. How can the guidelines be used effectively If they are 
admittedly provisional? 

6. How are nonverbal factors such as the use of gestures 
to communicate and convey meaning rather than oral 
language considered? 

7. How can it be assumed the student will perform at the 
same level in real life encounters? 

8. How is progress measured? 

9. How much dialectal variation should be ignored? 

10. How can there be enough time to conduct such 
assessment systematically? 



These and many other questions must be addressed in order for 
classroom teachers and others to be able to focus on the goal 
of oral proficiency. 
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II. PROFICIENCY LEVELS 

Proficiency here refers to oral language competence that 
a student uses to indicate general knowledge and life 
experience, not necessarily language competence that is 
related to instruction. For that reason, in assessing oral 
language proficiency it is not important to know how long a 
person has studied a language or what a student has learned 
from a program of studies, but what the student can actually 
do with the language at a given time (Hiple, 1986). The 
amount of the target language that a student possesses at a 
given time may be illustrated by a simple triangle (see Figure 
1). The oral language of the beginning target language 
speaker fills the area at the apex. As the student's ability 
and experience in the target language grow, the amount of 
language increases exponentially, that is, it increases not 
only in quality as grammatical constructions are added, but 
also in quantity as more and more vocabulary is added. The 
triangle figure will be used throughout the discussion of oral 
language proficiency assessment to scale the various 
proficiency levels and sublevels and to designate the other 
perspectives from which language assesssment must be viewed 
(Figures 2-4). 

Rating scale and components of proficiency levels 

There are several levels of proficiency that serve as 
indicators of the degree of functioning ability in the target 
language. The FSI 0 to 5 scale while useful at lower levels 
needed modification for use in school settings. The levels 
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Figure 1. Language Hierarchy 
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delineated by the ACTFL guidelines provide such modification 
and are illustrated in the form of a hierarchically arranged 
triangle (Figure 2). The ACTFL/ETS scale is divided into four 
major categories separated by major threshold points. These 
categories are Novice, Intermediate, Advanced, and 
Superior, Greater and greater linguistic ability is required 
in order to move from 0 to 5 (Novice to Superior) on the 
scale. 

Using the FSI rating scale that appears at the left, 
level 0 includes a range of no ability in the language 
whatsoever to no functional ability, that is, the speaker is 
limited to memorized material only. This level corresponds to 
the ACTFL descriptor Novice on the right side of the figure. 

FSI level 1 is defined as elementary (survival-level) 
proficiency and corresponds to the ACTFL descriptor 
Intermediate. At this level the speaker can create with the 
language; ask and answer questions on familiar topics; and is 
able to get into, through, and out of a simple survival 
situation . 

FSI level 2 is defined as limited working proficiency and 
corresponds to the ACTFL descriptor Advanced. At this level 
the speaker can narrate and describe in present, past, and 
future time and can get into, through, and out of a 
complicated survival situation. 

FSI level 3 is defined as professional working 
proficiency, level 4 is full professional proficiency, and 
level 5 is proficiency indistinguishable from that of an 
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educated native speaker (ENS). Because the B'SI scale was 
designed to assess oral language proficiency of adults' 
professional ability, the ACTFL scale was modified for use in 
school settings; consequently, levels 3, 4, and 5 are grouped 
into one level described as Superior. 

Levels divided at major thresholds points are further 
subdivided at minor threshold points and provide a greater 
number of definable stages of oral proficiency (see 
Figure 3). The areas of proficiency are described by the 
ACTFL Generic Descriptions for Speaking on pages 20 and 21 and 
are used to assess and rate students' oral language 
proficiency; these pages also serve as the beginning pages of 
the OLPA manual. 

In assessing oral language proficiency the subdivisions 
of the levels help to focus further the student's ability. 
The sublevels low, mid, and high are contained within both the 
novice and intermediate levels to provide additional 
proficiency benchmarks so that progress within these two 
levels can be measured (Liskin-Gasparro, 1984a). The advanced 
level is subdivided into advanced and advanced plus. It is 
the superior level that has no subdivisions on the ACTFL scale 
since, as previously stated, assessing oral language 
proficiency in school settings does not usually involve 
superior level students. The lower levels require further 
description and definition. 
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Figure 3. Proficiency Rating Scale 
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Generic Descriptions-Speaking 

Novice The Ncvtce level is charaaenzed by the ability to communicate minimally with learned material. 

Novtce-Low Oral produaion consists of isolated words and perhaps a few high-rrequency phrases. Essentially no func- 

tional communicauve ability. 

Novice-Mid Oral produaion continues to consist of isolated words and teamed phrases wuhm very predictable areas of 

need, although quality is increased. Vocabulary is sufficient only for handling simple, elementary needs and 
expressing basic courtesies. Utterances rarely consist of more than two or three words and show frequent long 
pauses and repetition of interlocutor's words. Speaker may have some difficulty produang even the simplest 
unerances. Some Novice-Mid speaken will be understood only with great difficulty. 

Novioe-High Able to satisfy partially the requiremenu of basic communicative exchanges by relying heavily on learned ut- 

terances but occasionally expanding these through simple recombinations of their elements. Can ask quesaons 
or make scatemcms involving learned matenal. Shows signs of sponuuidty although this falls short of real 
autonomy of expression. Speech continues to consist of learned unerances rather than of personalized* situa* 
tionally adapted ones. Vocabulary centers on areas such as basic objects* places, and most common kinship 
terras. Pronundatipn may still be strongly influenced by first language. Erron are frequent and« in spite of 
repetition, some Novioe-Hlgh speakers will have difHculty being understood even by sympathetic interlocuton. 

Intcnnedlfttc The Intermediate level is characterized by the speaker's ability to: 

--create with the language by combining and reoombining levned elements, though primarily m a reactive mode; 
--initiate, mininially sustain, and dose in a simple way basic communicative tasks; and 
—ask and answer questions. 

Intermediate- Low Able to handle successfully a limited number of interactive, task-oriented and soaal situations. Can ask and 
answer questions, initiate and respond to simple statements and maintain face-to-face conversation, although 
in a highly restriaed manner and with much linguistic inaccuracy. Within these limitation^, can perform such 
tasks as introducing sdf, ordering a meal, asking dtreaions, and making purchases. Vocabulary is adeq^ate 
to express only the most dememary needs. Strong interference from native language may occur. Misunderstand- 
ings frequcntiy arise, but with repetition, the Intermediate-Low speaker can generally be understood by sym- 
pathetic interlocutors. 

Intermediate-Mid Able to handle successfully a variety of uncomplicated, basic and communicative tasks and sodal situations. 

Can talk simply about self and family members. Can ask and answer questions and partidpate m simple con- 
versations on topics beyond the most immediate needs; e.a., personal hUtory and leisure time aatvities. Ut- 
terance length increases slightly, but speech may continue to be charaaerized by frequent long pauses, since 
the smooth incorporation of even basic conversational strategies is often hinder^ as the speaker struggles 
to create appropriate language forms. Pronunciation may continue to be strongly influenced by first language 
and fluency may still be strained. Although misundentandings still arise, the Intermediate-Mid speaker can 
generally be undentood by sympathetic interlocutors. 

Intermediate-High Able to handle successfully most uncomplicated communicative tasks and sodal situations. Can initiate, sus- 
tain, and dose a general conversation with a number of strategies appropriate to a range of drcumstances 
and topics, but erron are evident. Limited vocabulary still necessitates hesitation and may bring about slightly 
unexpeaed drcumlocution. There is emerging evidence of connected discourse, panicularly for simple narra- 
uon and/or description. The Intermediate-High speaker can generally by understood even by interlocutors 
not accustomed to dealing with speakers at this level, but repetition may still be required. 

Advanced The Advanced levd is charaaerized by the speaker's ability to: 

—converse in a deariy partiapatory fashion; 

—initiate, sustain, and bring to closure a wide variety of communicative tasks, including those that require 
an increased ability to convey meaning with diverse language strategies due to a complication or an unforeseen 
turn of events; 

—satisfy the requirements of school and work situations; and 
—narrate and describe with paragraph-length connected discourse. 
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Advanced Abie to satisfy the requirements of everyday situations and routine school and work requirements. Can han- 

dle with confidence but not with facility complicated tasks and social situations, such as elaborating, com* 
plaining, and apologizing. Can narrate and describe with seme details, linking sentences together smoothly. 
Can communicate facts and talk casually about topics of current public and personal interest, using general 
vocabulary. Shortcomings can often be smoothed over by communicative strategies, such as pause fillers, 
stalling devices, and different rates of speecn. Circumlocution wnich anses from vocabulary or syntactic 
limitations very often is quite successful, though some groping for words may still be evident. The Advanced- 
level speaker can be understood without difficulty by native interlocutors. 

Advanced*Plus Able to satisfy the requirements of a broad variety of everyday, school, and work situations. Can discuss 

concrete topics relating to panicular interests and special fields of competence. There is emerging evidence 
of ability to support opinions, explain in detail, and hypothesize. The Advanced-Plus speaker often shows 
a well developed ability to compensate for an imperfect grasp of some forms with confident use of com- 
municative strategics, such as paraphrasing and circumlocution. Differentiated vocabulary and intonation 
are tifceMty used to communicate fine shades of meaning. The Ad*/anoed-r>1us speaker often shows 
remarkable fluency and ease of speech but under the demands of Superior-level, complex tasks, language 
nuy break down or prove inadequate. 

Superior The Superior level is characterized by the speaker's ability to: 

-^partidpate effectively in most formal and informal conversations on practical, social, professional, and 
abstract topics; and 
suppon opinions and hypothesize using native-like discourse strategies. 

Superior Able to speak the language with sufficient accuracy to participate effectively in most formal and informal 

conversations on practical, social, professional, and abstraa topics. Can discuss special fields of competence 
and interest with ease. Can support opinions and hypothesize, but may not be able to tailor language to 
audience or discuss in depth highly abstraa or unfamiliar topics. Usually the Superior level speaker is only 
panially familiar with regional or other dialectical variants. The Superior level speaker commands a wide 
variety of interactive strategies and shows good awareness of discourse strategies. The latter involves the 
ability to distinguish main ideas from supporting information through syntactic, lexical and suprasegmental 
features (pitch, stress, intonation). Sporadic errors may occur, particulariy-in low-frequency structures and 
some complex high-frequency struaures more common to formal writing, but no patterns of error are evi* 
dent. Erron do not disturb the native speaker or interfere with communication. 



22 



In addition to levels and sublavels, another 
consideration in oral proficiency assessment is the Functional 
Trisection ( ETS Oral Proficiency Testing Manual , 1982) (see 
Figure 4)« In assigning ratings, the interviewer considers 
the student's overall or global speaking performance. This 
means that the student must be able to function in specified 
contexts with suitable accuracy . The student's language must 
be viewed, then, from three different per^.pectives: 

(1) function or specific task the student must perform, 
such as asking questions or giving information. 

(2) context or subject matter or situation the student 
must address or deal with, and 

(3) accuracy or degree of intelligibility of grammar, 
vocabulary, fluency, pronunciation, and sociolinguistic- 
culture factors that the student demonstrates. 

We need to ask not only "Was the student ablp to 
communicate?" but more importantly "What was the student able 
to communicate and how well?" (Higgs & Clifford, 1982). The 
"what" requires consideration of both xunction and context ana 
the "how well" requires considerations of degree of accuracy. 

The Functional Trisection lor oral proficiency assessment 
enables the interviewer to make a global assessment and also 
provides for balance in test design and curriculum development 
(Omaggio, 1934). Detailed information for each area of the 
Functional Trisection follows. 
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Figure 4. Proficiency Rating Scale with Functional Trisection 
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FUNCTIONAL TRISECTION OF ORAL PROFTnTRMPy r^uprg 



Oral 

Proficiency 
Level 



Function 

rraslcs accomplished, 
attitudes expressed , 
tone conveyed) 



Context 

TTopTcT, subject 
areas, activi- 
ties, and Jobs 
addressed) 



Accuracy 
(Acceptability, 
quality, and 
accuracy of 
message conveyed) 



(Superior) 



Functions equivalent 
to an educated native 
speaker (ENS). 



All subjects. 



Performance 
equivalent 
to an ENS. 



(Superior) 



Able to tailor 
language to fit 
audience, counsel, 
persuade, negotiate, 
represent a point of 
view and interpret 
for dignitaries. 



All topics 
normally perti- 
nent to profes- 
sional needs. 



Nearly equivalent 
to an ENS. Speech 
is extensive, pre- 
cise, appropriate 
to every occasion 
with only 
occasional errors. 



(Superior) 



Can converse in formal 
and informal situa- 
tions, resolve problem 
situations, deal with 
unfamiliar topics, 
provide explanations, 
describe in detail, 
offer supported 
opinions, and hypo- 
thesize . 



Practical, 
social, profes- 
sional and 
abstract topics, 
particular 
interests, and 
special fields 
of competence. 



Errors never 
interfere with 
understanding and 
rarely disturb the 
native speaker. 
Only sporadic 
errors in basic 
structures. 



(Advanced) 



Able to fully partici- 
pate in casual conver- 
sations, can express 
facts, give instruc- 
tions, describe, 
report, and provide 
narration about 
current, past and 
future activities. 



Concrete topics 
such as own back- 
ground, family, 
interests, work, 
travel, and 
current events. 



Understandable to 
native speaker 
not used to 
dealing with 
foreigners, some- 
times miscommuni- 
cates. 



1 

(Inter- 
mediate) 


Can create with the 
language, ask and 
answer questions, 
participate in short 
conversations. 


Everyday survival 
topics and 
courtesy 
requirements . 


Intelligible to 
native speaker 
used to dealing 
with foreigners. 


a» 

(Novice) 


No functional ability. 


None. 


Unintelligible. 


* Novice 


Level is not discussed here 
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FUNCTIONS 



4 


Represents point of view 




(Superior) 


Negotiates 

Persuades 

Counsels 

Tailors language to audience 




3 


Handles unfamiliar topics or situations 




(Superior) 


Hypothesizes 

Provides supported opinion 




2 

(Advanced) 


Gets into, through and out of survival 
situations with a complication 

Narrates 

Describes 




1 

(Intermediate) 


Gets into, through and out of survival 
situations simply 

Asks questions 

Answers questions 

Creates 


— - 


0+ 

(Novice High) 


Communicates with memorized material 




0 

{Of Novice LoMf 
Novice Mid) 


Has no functional ability 
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4 All nontechnical situations 

(Superior) Any conversation within the range of personal 
or professional experiences 

All topics normally pertinent to professional 
needs and social of a general nature 

3 Expression and defense of opinions about 

, current events and similar topics 
(Superior) ^ 

Most formal and informal conversations 

Practical, social, professional and abst ract 
topics 

Particular interests and special fields of 
competence 



Recreational activities 
Limited work requirements 

Most social situations including introductions 

Concrete topics such as own background, family 
and interests, work, travel and current events 



Simple question-and-answer situations 

(Intermediate) Familiar topics within scope of very limited 

language experience 

Routine travel needs 

Minimum courtesy requirements 



Everyday survival topics 



0+ 


Basic objects 


Family members 


Months 


(Novice High) 


Colors 


Weather 


Day's date 




Clothing 


Weekdays 


Time 



0 

(Novice Low, Some of the 0+ subject areas (above) 
Novice Mid) 



2 

(Advanced) 
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ACCURACY 



4 Only occasional unpatterned errors 

(Superior) Nearly perfect grammar 

' aterial » 

Errors of grammar quite rare .:iicate 

ability 

naaceria 

3 Occasional errors in low-frequency toan inte 

structures ii.iiMally 

(Superior) 

Occasional errors in tne most complex ^^-^ 
frequent structures 

.tn lang 

Only sporadic errors in basic structures 

questio 

Errors never interfere with understanding 

and rarely disturb the native speaker - '?""*5 anc 

Control of grammar good 

♦ 

2 Joining sentences in limited discourse ^ i^p-^r:^' 

(Advanced) Good control of morphology of the language 

(in inflected languages) and of the raost'''^^i'^^ i 
frequently used syntactic structures 

Elementary constructions usually handled ^l'* ^^^^ 
quite accurately, but does not have a 
thorough or confident control of grammar 

Some miscommunication 

^"s, hypo 

Understandable to a native speaker not used 
to dealing with foreigners 

0 gh, and 



1 Normally errors made even in constructions 

which are quite simple and common 

( Intermediate) 

Errors in pronunciation and grammar frequent 

Intelligible to a native speaker used to 
dealing with foreigners 



0 No functional ability (some intelligibility 

expected) 

(Novice) 
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Student Characterization 
The Novice level speaker 

(with no learned material) 
— is unable to communicate 
— has no functional ability 

(with some learned material) 
— can react rather than interact 
— can communicate minimally 

The Intermediate level speaker 

—begins to create with language and to interact 

—can ask and answer questions on familiar topics 

—can get into, through, and out of a simple survival 
situation 

The Advanced level speaker 

—can perform at the Superior level sometimes, but not 
consistently 

—can narrate and describe in past, present, and future 
time 

—can get into through, and out of a survival situation 
with a complication 

The Superior level speaker 

—can support opinions, hypothesize, and talk about 
abstract topics 

--can get into, through, and out of an unfamiliar 
situation 
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An example provided by Higgs and Clifford (1982) also 
illustrates the characterizations of the various levels. 



The following hypothetical examples, based on the 
performance of State Department visa officers, will 
serve to demonstrate the various proficiency levels 
in performing the rather elementary task of passing 
on some factual information to a visa applicant: 

Level Visa Officer's reply to applicant 

5 Under U.S. statutes, your affiliation with 
the Communist Party renders you ineligible 
for a regular tourist visa. There exist, 
however, waiver procedures which may be 
invoked. These are the steps that you 
should initiate • • • • 

4 According to U.S. lawss your affiliation wiz 
ze Communist Party makes you uneiigible for 
a regular tourist visa. You may, however, 
request a waiver, Zis iss what you must do 
• • • • 

3 Zee laav zayz zat mambears of zee 

Communistic Partee caanoht bee geeven a 
regoolair tooreest veesaa. Owehvair, 
egzeptions are zohmtaymes dunn. You must do 
zees • • • • 

2 You cannot legulally get toolist visa. It 
is not light, because berong to Communistic 
Palty. But you can ask for a special 
permission. You to do this . . • . 

1 You commyunist. No gyet vyisa. Got tryy 
agyain. Take thyis. Fyill in, plyeez. 



These examples have been purposely contrived to demonstrate to 
Americans having limited experience with foreign languages 
what they themselves might sound like to a foreigner when 
attempting to communicate in the foreign language. The visa 
officer in each example was at least partially successful in 
communicating the fact that the applicant had to reapply using 
other procedures, but it should also be obvious that the total 
information communicated impressions about the speaker's 
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intelligence and social status. As the officer's proficiency 
decreased, increasing demands were put upon the applicant to 
interpret the message. Under these circumstances the officer 
cannot depend on a sympathetic listener for moral and 
linguistic support. (Higgs & Clifford, 1982, pp. 64-65) 
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III. INTERVIEWING 

The oral interview responds to the need to focus 
evaluation of a student's oral language proficiency on how 
well the student can ba predicted to function in life 
situations (Brown, 1985). It is a proficiency test, not a 
progress test or achievement test. In the oral interview, 
each question has a specific linguistic and contextual purpose 
although the questions appear to be spontaneous and 
conversational. The interviewer knows the characteristics of 
each level on the proficiency hierarchy and seeks to find the 
student's level of linguistic breakdown, the level at which 
the student can no longer maintain linguistically accurate and 
culturally appropriate performance (Buck & Hiple, 1984). This 
is accomplished, however, w"thin a congenial ,, comfortable 
atmosphere. To summarize, the oral language proficiency 
assessment interview is a seemingly informal conversation that 
in reality constitutes a highly structured and hierarchical 
exercise in establishing a leve] of sustained linguistic 
functioning ability. 
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Interview techniques and procedures 

The oral interview has four phases (Buck & Hiple, 1984): 

1 . Warm-up 

The student is put at ease and the conversation is begun 
with social amenities such as ''Hello. How are you?" The 
interviewer must determine after the initial responses how to 
proceed with the second phase. This phase usually helps 
establish a floor or baseline of oral language proficiency. 

2. Level check 
During the warm-up phase the interviewer senses the 

level which he or she believes represents the student's 
proficiency. During the level check questions are asked that 
validate or correct the interviewer's initial impression and 
that check the student's linguistic strengths. 

3. Probes 

During this phase the interviewer uses probes to check 
the student's ability to speak at the next higher level and 
to discover where linguistic breakdown may occur. Probes 
provide a way to seek a ceiling of oral language proficiency, 
the highest sustained level at which a student speaks, and 
discover the student's linguistic weaknesses. 

4. Wind-down 
During this phase the interviewer returns to more 

familiar structures and topics in an effort to end the 
interview with a feeling of success for the student. 

o 3 7 
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The purpose of the interview is to find the ceiling, the 
highest sustained level at which the student can maintain the 
speech sample during the interview. During an interview, 
however, a student's performance usually varies and includes 
areas of linguistic strengths and weaknesses. There are times 
when the student may go beyond the sustained level and reach a 
peak level, defined as the uppermost level at which a student 
performs on an isolated topic during the interview ( ETS OP 
Testing Manual , p. 15). Probes are used during these times to 
determine whether the speaker has reached only a peak level or 
whether it is indeed the speaker's sustained level or 
ceiling. It is important to note that one strength or one 
weakness will never determine a rating. One error counts 
nothing. A single error will not eliminate a student from 
qualifying for a higher level, but a pattern of weaknesses or 
errors will; hence, it is important to probe with higher level 
questions or speech elicitations. It is also important to 
keep in mind that 

each individual possesses a variety of language 
skills, and competence and performance will vary 
depending on the context or setting of language use, 
the interactants, their relationships and relative 
statuses, the domain of the communicative intent, 
and the topic. (Willig, 1985, p. 301) 

In order to facilitate the interview process, it is 
helpful to note the importance of three techniques, (1) 
questioning, (2) role playing, and (3) the use of props. 
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During the interview many types of questions are used as 
well as prepared role play situations as level checks or 
probes. Role plays range from basic survival situations, to 
complicated situations, to abstract linguistic tasks (Buck & 
Hiple, 1984). 
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Question Types and Role Plays 

The following question types can be used in administering oral 
language proficiency interviews. They are taken and adapted from 
Handbook on Question Types and Their Use In LS Oral Proficiency 
Tests (Preliminary Version) by Pardee Lowe. Jr.; Lanizuaee 
School: May 1976. (Revised 1981). 

1. YES/NO QUESTIONS 

Example: "Do you live in Miami?" 

Description: The Yes/No Question can be answered by one 
word, yes or no; or by yes/no, followed by a 
repetition of the words in the question or more 
extensive information. 

1. A. REGULAR STATEMENTS WITH QUESTION INTONATION 

Example: "You went to the cafeteria." "Your brother is 
sick?" 

Description: A regular statement is ipade using regular 
word order and without any question words, but the 
whole statement is spoken with question intonation. 

2. CHOICE QUESTIONS 

Example: "How did you come to school this morning, by bus 
or by car?" 

Description: A Choice Question provides within the 
question itself at least two possible answers* 

3. POLITE REQUESTS 

Example: "Please stand up." "^^ould you describe this room 
please?" 

Description: The Polite Request is a command or question 
phrased in a polite, friendly way. A Polite Request 
may involve certain politeness adverbs or particles or 
even subjunctive forms, depending on the language. 
Requests should always be presented in a polite, 
friendly manner to avoid any feeling on the part of 
the candidate that he is being forced to do something. 
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QUESTION TYPES (cont.) 



4. INFORMATION QUESTIONS 

Examples: "Who was with you?" "v/hom/Who did you see?" 
"What did you expect?" "When were you there'" "W 
did he come?" "How did he get he'-e?" — When 
eliciting fact, not opinion. 

Description: The Information Question elicits a speech 
sample containing facts rather than opinion. It 
begins with a question word and cannot be answered 
with a simple yes or no . 



4. A. INFORMATION QUESTIONS WITH PROPS 

Examples of Props an d Items to be Elicited Possible Prop= 

Window with 
outside view 

Giving dates (from easy to difficult) Calendar 
Following directions Mao 
Identifying Objects Set of 

pictures or 
objects in 

w iii , a_ testing room 

Telling what candidate/others have on Candidate or 

Identifying actions Set^of^^^ 

pictures 

Description; Polite Requests and Information Questions are 
combined to ask the candidate to produce simple 
sentences or vocabulary with the aid of a prop (some 
concrete object, such as a picture, calendar, etc.). 

5. FAMILIAR SITUATIONS 

Example: "Order a hamburger and french fries." 

Description: The Familiar Situation consists of a 

situation in which the student role-plays to get basic 
necessities of life. The purpose of the situation or 
role-play is to pin down aspects of the student's 
language that have not evolved in the conversation 
format. Situations, or role-plays, are a valuable 
component of oral interviews at all It vels, but 
particularly at the lower end of the rating scale. An 
interviewer should have several situations for each 
level on hand for each interview and should always set 



37 



QUESTION TYPES (cont.) 



the stage for th: role-play. For students who read, 
it is often hclplul to give them an index card with a 
description of a role-play situation so that they will 
more fully understand the instructions. The 
interviewer also plays a role in the situation. 
(Note: There are no situations/role-plays, however, 
for the Novice level but modified Intermediate level 
situations may be effective with some students.) 



5A. FAMILIAR SITUATIONS WITH A COMPLICATION (Higher language 
levels) 

Example: "You are in the cafeteria. You have eaten most 
of your lunch when you discover a bug on your 
lettuce. You feel ill. Call your teacher and tell 
her/him about the problem." 

Description: The Familiar Situation with a Complication 
consists of a script for role-play in which an 
unforeseen difficulty occurs in an encounter concerned 
with survival needs. 



6. STUDENT INTERVIEWS INTERVIEWER 

Example: "I've been asking you questions; now I'd like for 
you to ask me some questions." 

Description: The student asks questions of the interviewer 
to test student's facility with question structures. 



7. REPHRASABLE QUESTIONS 

Example: "Please elucidate the functions of a bicameral 
legislature." "Please explain how the two houses of 
Congress make our laws." 

Description: A Rephrasable Question is a question that 
allows the interviewer to probe at a higher level, 
then rephrase at a lower level. 



3. HYPOTHETICAL QUESTIONS (Higher language levels) 

Example: "If you had a million dollars, what would you 
do?" 
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QUESTION TYPES (cont.) 

Description: The Hypothetical Question sets the stage for 
a discussion of the possible, either now, in the 
future, or in the past. In some languages, lilce 
bnglish, there is a large number of variations which 
may be used in the sentence frame. 

Examples of Frames: 

"If you had the ability, what would you like to be?" 
Had you been there, what would you have done 
differently?" 

"Assume you have the opportunity of reshaping the city 
"Assuming* would you marry human with business needs?" 

"Let's assume . . . . " 
"Let's pretend . . . . " 
"Suppose . . . . " 
"Supposing ....•> 
"Let's suppose . . , . " 
"Granting . . . . " 
"Granted . . . . " 

9. UNFAMILIAR SITUATIONS 

Example: "You are in charge of the sports equipment in 
your class. Explain to the other students the rules 
for using the equipment: sign-out sheet, return after 
use, cars of the equipment." 

Description: The Unfamiliar Situation contains the kernel 
of a situation with which a student might have to deal 
in everyday life. Unlike a Familiar Situation, the 
Unfamiliar Situation should contain elements likely to 
be unknown so that his/her ability to make his/her 

adequa?e?y"ies'?l§!'' °' ''''' vocabulary, can be 

10. DESCRIPTIVE PRELUDES 

^''^"^ioin/^^" have heard that the school soccer team is 
the ?oa?h?i^ 
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Description: The Descriptive Prelude is a series of 

2nnfJ 2^ or statements designed to introduce a new 

listening comprehension, and suggest a 
prod!ctJon!'''^ °' student's f?eech 
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QUESTION TYPES (cont.) 



11 . STUDENT-PROMPTED QUESTIONS 

Example: "What is college like?" 

Description: The Student Prompted Question is one to which 
the student leads the interviewer. It arises when the 
student is able to talk about or suggest an area of 
personal or professional interest, obviously knows 
something about it, and wants to discuss the topic 
further. 



12. OPINION QUESTIONS 

Fact versus Opinion Questions 

In the presentation of Question Types, the majority of 
the Question Types listed so far have been Fact 
Questions. B'act Question3 have two distinct limitations: 

A. They may lead the interviewer to rate on factual • 
rather than on linguistic content. 

B. They may degenerate into an interrogation. 

Example: Interviewer: "Do you like living here?" 
Student: "Yes." 
Interviewer: "Why?" 

Description: At the higher levels. Opinion Questions are 
more useful because they encourage the student to give 
examples of more complicated linguistic structures in 
his/her answers. Opinion Questions are those which 
elicit SUPPORTED OPINION . Obviously, lower level 
speaker can say two-word phrases such as "I agree," "I 
don't believe it," etc. However, to support his/her 
opinion, "I do not agree because . . . ," may require 
the student to control more complex verb forms, to 
follow a sequence of tenses, or employ the correct 
word order. Because test time is precious, it is 
important to make the student talk as much as 
possible. This can often be accomplished by phrasing 
Opinion Questions provocatively to encourage the 
student to choose sides or express an opinion. 



QUESTION TYPES (cont.) 



12. (cont.) 

Some English Examples of Verbs of Saying and Feeling 
ASSERT: "Would you really assert that?" 

BE AGAINST: "Why are you against that?" (colloquial) 

BE FOR: "Why are you for that?" (colloquial) 

BELIEVE: "Why do you believe that?" 

CITE: "Can you cite your reasons for that 
(statement)?" 

FEEL: "Why do you feel that that Is so?" 

"How do you feel that that helped?" 
(colloquial ) 

MAINTAIN: "Why do you maintain that he acted that 
way?" 

SAY: "Why do you say that?" 

"What do you say to that?" (colloquial) 
THINK: "Why do you think that?" 

"What do you think about that?" (colloquial) 
VIEW: "How do you view that?" 
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Props 

The use of props is often essential in interviewing, A 
prop is a visual aid to use as an object of discussion. Props 
not only help reduce anxiety in the student, they also serve 
as valuable aids in communication and understanding, 
particularly with children and at the Novice level regardless 
of the age of the student. All classroom teachers are 
accustomed to using props or visual aids in eliciting language 
and thought in their students. During oral language 
proficiency interviews, props offer a comfortable vehicle and 
provide a topic of conversation when the interviewer 
question/student answer format is not possible or effective. 
Examples of props are clear and simple pictures of single, 
ordinary objects such as a picture of a red apple and simple 
scenes such as children playing with a ball. One technique 
that is helpful in interviewing is for the interviewer to have 
a ready supply of cards with pictures or photographs 
categorized according to the four levels. Novice, 
Intermediate, Advanced, and Superior, Since such a card 
catalog is not available as part of the ACTFL Proficiency 
Guidelines, this is one way classroom teachers may adapt 
existing curricular and instructional material' in order to 
use the Guidelines more effectively. The key to successful 
materials adaptation, however, is mastery of the ACTFL Generic 
Speaking Descriptions and other pertinent information that 
helps to separate the proficiency levels so that the level of 
the props used will correspond appropriately with each level 
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of proficiency. Props such as actual objects (a real apple) 
or puppets are also helpful. Again, the success of using 
props is dependent on how well the prop matches the oral 
language proficiency level of the student. Culturally biased 
questions and props are obviously not helpfal and the 
interviewer can obtain more representative language samples 
when the student does, indeed, understand the significance of 
the prop or question. 

Another technique is the use of "minimal encouragers, " 
that is, the interviewer acknowledges the student's answers or 
comments but offers minimal encouragement and no personal 
elaboration of the student's statements. Even though the 
conversation is meant to be informal yet structured, the 
Object is for the student to do the talking, not the 
interviewer. At times it is necessary for the interviewer to 
set up a rola play situation or comment more extensively, but 
the general rule is to keep comments to a minimum. The 
interviewer's silence is also a good way to prompt the student 
to continue speaking. Examples of minimal encouragers are: 



Yes. 



No. 



Sure . 



Yeah. 



Really? 



Fine. 



Yep. 



Right. 



That's interesting. 



Uh huh. 



Correct. 



Great. 



O.K. 



I see. 



Oh. 



Of course. 
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Interviewer bias and mistakes 

As with any sub;)ectlv6 appraisal of performance, there 
are many areas of potential bias that the Interviewer must be 
aware of and guard against. For Instance, a distinction Is 
often made between students who have learned the target 
language In school settings and those who have learned It by 
living In the target language environment ( ETS OP Testing 
Manual , p. 18), A student who has learned the language In 
school may be strong In grammar but weak In everyday, 
vocabulary. On the other hand, a student who has learned by 
living In the target culture may know a great deal of 
vocabulary but use Incorrect grammar. It Is Important In 
rating not to compare students' performance with other 
students at the same level but with the ACTFL Generic 
Descriptions for Speaking. When the Interviewer Is thoroughly 
familiar with the descriptions and their use In evaluating 
language samples, the potential for subjective bias In 
assessment Is greatly reduced. Evaluating becomes a matter of 
seeking the facts embedded In the language sample that are 
specifically delineated In the Generic Descriptions. That Is 
not to say that bias does not exist, but that when a judgment 
Is made, the Interviewer has made the determination based on 
the facts of the language sample. A parable by Pardee Lowe 
( ETS OP Testing Manual , p. 19) Illustrates how standards can 
drift when ratings are based on factors other than the level 
descriptions. 
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The Story of Ice Cream 

>wa> J^"*^,?^ Ice Cream there was once a law that stated 

that the designation "creamy ice cream" could be applied only 
to those batches of ice cream whose butterfat content was 30 
percent or higher. Two ice cream testers were designated to 
check each batch so that the law could be applied uniformly. 

One day, however, an ice cream manufacturer said that a 
batch he had produced, which the testers showed had 27 percent 

"J^®"?^* content, was in fact a true "creamy" ice cream! He 
said, "Taste it for yourselves!" ^feaa. ne 

So a group of four managers plus the testers inspected 
the ice cream. One pointed out that it was "creamy" to 
touch. Another indicated that it had a "creamy look." Two 
h^JJoiS^J "tasted creamy." The two testers said that the 
butterfat content was 27 percent, which did not conform to the 
fi™??^Iu f*^"^ designation "creamy." One of the testers did 
admit that such a batch of ice cream might "taste creamy." 

But by this time, the managers were feeling sorry for the 
ice cream manufacturer because he had tried so hard and had 

K-f ![1 P^f®*^ over for a promotion, and they declared that 
the batch of ice cream was Indeed "creamy." 

P.S. In subsequent years, the definition of "creamy" ice 
5h«?°^.h®°?°S so completely divorced from the butterfat content 
that the inhabitants of that land discovered one day that ice 
cream and ice milk were differentiated only by the packaging. 

Two students can give very different performances and 
still be at the same level. The most extreme cases are those 
of the school and nonschool learners described above, but any 
two individuals will use the language at their disposal 
differently. Practically no speech sample will exactly match 
a level description in all respects. However, it is possible 
for two samples to be assigned the same rating if they show 
patterns of strength and weakness that fall within the 
boundaries of a given description. 

The following potential intei-ferences and biases provide 
a beginning point from which an interviewer's personal 
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attitude awareness inventory may be developed: 

Interviewer's level of oral English language proficiency, 
dialect , mannerisms , v.^lue orientations , and cultural biases. 
Checklists , formats , suggestions 

It is often helpful to have at hand a basic checklist to 
insure that all details are covered and accounted for prior to 
a more formal interview. The following pages include 
information that is useful toward this end and also include 
suggestions and practical hints for interviewing. 
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OLPA Manual, p. 10 

Interview Checklist 

Yes No 



Novice Tried to have conversation? 
level 

Covered Novice Subject areas: 



Comments: 
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Basic Objects 

Body parts 

Colors 

Clothing 

Day's Date 

Family members 

Foods 

Months 

Numbers 

Time 

Weather 

Weekdays 

Year 



s. 
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OLPA Manual, p. 11 





Interview Checkliat" 








Yes No 


Inter- 
mediate 
level 


Tried to have conversation? 

Checked for minimum courtesy requirements? 







Checked that student can handle simple 
situations of daily life? 







Had student ask you questions? 






Probed for narration in oast anH •Pn+'iina 
time? 






Tried props when conversation failed? 




Comments: 


• 
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OLPA Manual, p. 12 

Interview Checklist 



Yes No 



Advanced Checked for ability to handle routine 
level social demands? 

Checked autobiographical information? 

Checked current events? 

Checked basic structures? 

Checked more complex structures? 

Checked for description? 

Checked for narration, particularly in 
past and future? 

Checked for joining sentences in 
connected discourse? 

Checked for situations with a 
complication? 

Probed unknown topic or situation? 
Probed for supported opinion? 



Comments: 
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OLPA Manual, p. 13 

Interview Checklist 



Yes No 



Superior Checked both everyday and abstract 
level subject matter? 

Placed student in unfamiliar situations 
and topics? 

Checked control of grammar? 

Checked for supported opinion? 

Checked for ability to hypothesize? 

Checked for detailed description and 
narration? 

Checked for use of low-frequency 
structures? 

Checked for broad vocabulary? 

Checked for use of complex structures? 

Checked for specialized vocabulary? 

Checked for ability to tailor speech 
to audience? 

Checked for high level colloquialisms? 
Checked for cultural references? 

Checked for ability to converse freely 
in own fields? 

Checked for ability to sound and speak 
like an ENS? 

Comments: 
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OLPA Manual, p. 14 

Source: Adapted from ETS Oral 
Proficiency Testing Manual. 1982, 

Appendix IV, p. 12 



FORMAT FOR INTERVIEWING 



I . BEFOR: ^ THE TEST : 

A. P^ad the ACTFL Generic Descriptions for Speaking (the 
proficiency definitions) before the interview, 

B. Prepare specific questions for various levels, 
II. INTERVIEW ; 

A. WARM-UP ; Never skip this phase. Be sure the student 
gets into the language as comfortably as possible, 

B. LEVEL CHECK : Find level. Test for accuracy of grammar 
and breadth of vocabulary of several areas of interest. 

C. PROBES : Be sure to push student to the uppermost level 
of ability in the language. This should happen at 
least three or four times, 

D. WIND-DOWN : Drop to a slight?y lower level. Student 
should end interview with feeling of accoinplishment , 

III. AFTER THE TEST : 

A, Reread the ACTFL Generic Descriptions for Speaking (the 
proficiency definitions), 

B, Note problems with this particular interview, 

C, Note any useful areas of interest, questions, or 
techniques for future use, 

IV. RATING ; 

A, Rate as soon as possible after the interview even if 
recorded, 

B, Do not discuss performance in the student's presence, 

C. Go through student's overall performance to yourself. 

D. Refer to checklists and manual to determine rating. 
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Suggestions for Interviewing Children (Adapted from 
Erlckson, pp. 285-283, In Erlckson & Omark, Eds., 1981). 

The following discussion provides general information and 
specific suggestions for interviewing children for the purpose 
of obtaining a sample of oral language. It Is important to 
have an Informal atmosphere even when conducting specific 
probes Into a child's language structure or language function. 

There are several constraints Inherent In an Interview 
situation which may limit a child's verbal output. A child's 
Interactions with adults are less free than those \fith peers 
or persons familiar to the child. Differences In language use 
and Complexity also occur. One reason for the differences Is 
the adult's tendency to play a role of questioner which 
imposes restraints on conversational potentials. Another 
reason relates to perceived status and language level 
differences between the speakers. Awareness of these problems 
and limitations should help an Interviewer modify behavior and 
maximize the potential for obtaining Information from a verbal 
Interaction with a child. The establishment of rapport Is 
paramount for obtaining a language sample that represents a 
child ' s optimal output. 

In order to maximize the potential for establishing 
rapport with a child, an Interviewer must be aware of personal 
perceptions of conversational roles and attitudes toward 
children. An Interview with a child should be couched In 
three basic premises: 
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1. It is important to view the child as a person who has 
something worthwhile to say and the potential for 
sharing it with an interested listener. 

2. The child deserves the same conversational rights as 
an adult— not answering, answering with incomplete 
utterances or ellipses, directing the conversation, 
interrupting, and so forth. 

3. If the interview is not going well, it is the 
interviewer's responsibility and not the child's.- 

It may be that the interviewer is talking at rather than with 
the child or that he or she is interrogating rather than 
conversing. One of the basic problems may be that the 
interviewer does not present verbal and nonverbal behavior 
that indicates listening, including interest in what the child 
says. 

Additional Suggestions 

1. Use materials suitable to the age or level of functioning 
of the child. For example, for preschoolers, actual toys 
usually produce more speech than pictures of toys. Toys 
that have moving parts, as well as at least one broken 
toy, are good stimulus materials. In general, books, 
toys, and brightly colored pictures are especially useful 
for kindergarten and elementary school children. 

2. Consider the physical characteristics of the situation, 
It should lend itself to a naturalistic interaction 
rather than a structured situation such as two 
interaotors seated formally at a table. 
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3« Present the child with a few items and allow for freedom 
of selection. When the child h-^s made a choice, watch 
what the child does with it and use the activity as a 
basis for conversation. If the child does not talk, make 
general statements such as "I wonder what's happening," 
"What does it make you think of?", "I'm interested in 
your story about the picture." Avoid questions such as 
"Do you want to (or can you) tell me about that picture?" 
for which the child has the right to answer "No." 

4. If statements or questions produce no response to 
stimulus items, demonstrate what you require of the 
child. For example, take a toy yourself and play with 
it, telling about what you are doing and personalize your 
account using an imaginary situation. 

5. When the child chooses a picture and does not respond to 
questions, demonstrate how to talk about a picture. If 
you have any indication of the child's language 
comprehension, suit your input to a level that you are 
confiaent the child can follow, keeping in mind that if 
it is too simplistic you will be providing a model of 
what you expect from the child. 

6. Vary the situation. Try to obtain a sample with the 
child playing a game such as keeping house, then building 
something, then playing with toys, etc. 

7. Interview indoors and outdoors or at the child's home if 
possible . 

8. Record what you say. 
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9. It is important to remember that when in doubt about the 
level at which a student should be rated, rate 
conservatively. Choose the lower level, particularly at 
major thresholds. 

10. Make an effort to provide smooth transitions between 
areas of conversation. 

11. Converse with the child as the child is interacting with 
peers during play time or a classroom activity that lends 
itself to conversation. 

12. Use a normal conversational tone and avoid the sing-song 
presentation of memorized questions that often 
characterizes teacher talk. 

13. Avoid colloquialisms until a proficiency level has been 
tentatively reached. Informal conversations lead to use 
of idioms that may be familiar to the interviewer but not 
to a LEP student. 

14. Allow time for the student to respond. 

15. Speak at a normal rate of speed, not too fast, not too 
slowly. 

16. Remember that questions should elicit language, not 
necessarily information. 

17. Allow time for the warm-up. Often students need a few 
minutes to settle into the interview format. The 
interviewer should try to create an atmosphere in which 
the student feels at ease and unstressed. 
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18. Do not correct the student during the interview even when 
the student reverts to words in the native language. 
Rephrase question or allow student to circumlocute . 

19. Do not give the student a word or phrase. Ask the 
student to say it or describe it in another way. Or say, 
"That's O.K., let's go on to something else." 

20. Do not take notes during the interview. One of the most 
important caveats regarding oral language proficiency 
assessment interviewing described here is that the 
interviewer must conduct the interview as a conversation 
and not take notes or include other distractions such as 
referring to the guidelines. 

21. Remember that experience enhances efficiency and 
expertise. 

22. If it is a formal interview, explain the purpose of 
interview to student. If informal, it is not always 
necessary. Inform students generally of the proficiency 
focus as class procedure. The goal is proficiency which 
comes from motivation, practice, and learning as the way 
to become proficiert, not memorizing for discrete-point 
testing. 

23. A good mid is a good mid, not a high. 

24. Pauses are ratable. 

25. Be sure questions are open-ended and not discrete-point, 

26. Allow time for an ample response. 

27. Be purposeful and not content-based (We're testing 
language and not knowledge of a subject). 
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28. Be conversational and be sure to link the questions 
together . 

29. Keep in mind that the conversational style lends itself 
to colloquialisms, abbreviated speech, and informal 
pronunciations that novice level students may not 
understand. 

30. Examine your own language strengths and weaknesses. Do 
you revert to informal speech patterns when outside of 
the teacher mode yet use formal language when teaching? 

Problems to Avolri 

1. Avoid asking very specific questions that elicit yes/no 
answers or questions typically resulting in one word 
responses (e.g., "What's that?" ("A horse"); "What is it 
doing?" ("Running"); "What do you see?" ("A fork"); "Do 
you have one of those?" ("Yes/No")). 

2. Avoid asking the child to tell a very familiar story that 
is known by heart or involves a lot of repetition of 
sentences (e.g., Goldilocks and the Three Bears ). 

3. Recognize the limitations of your props. For example, a 
doll house limits the child to furniture vocabulary, and 
action pictures can limit the child to the present 
progressive tense. 

4. Modify your statements so they do not lock the response 
set. For example, asking "What is he doing" will 
probably elicit gerund form responses; questioning may 
only give you samples of declaratives and not allow the 
child to demonstrate the use of interrogatives ; 
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conversation related to materials present may never allow 
an opportunity for the child to generate past tense 
markers; talking about single items limits the potential 
use of plural markers. 

5. Do not present only boy-like or girl-like toys or 
pictures, but allow for choice in that children will vary 
in their interest and background of experience. 

6. Do not be concerned by silences to the point of filling 
in the gap with your own verbal output. The focus is on 
obtaining a language sample of the child rather than of 
the interviewer. 
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IV. STUDENT VARIABLES 

Although the ACTFL/ETS interview technique is an 
excellent and established test of oral proficiency, there 
remains the need to modify it further for application in 
elementary, high school, and even college settings (Frink, 
1982). Elementary classroom teachers in bilingual and ESL 
programs in particular must consider many variables in 
evaluating their students' oral language proficiency. These 
variables may be categorized into three areas: 

1. students' ages and developmental stages, 

2. cultural and environmental factors, and 

3. students' personal and affective characteristics. 
Ages and developmental stages 

For many years children's abilities have been measured 
and cross-cultural research carried out using Piagetian 
techniques, particularly the conservation-of-quantity 
experiment (Ashton, 1975). The experiment evaluates a child' 
ability to judge that the amount of liquid in a short, wide 
beaker remains the same when the liquid is poured into a tall 
thin beaker. Children from many cultures have been subjects 
for this experiment. Their cognitive structures have been 
compared and findings have revealed similarities and 
differences among children of different cultures. 

A brief discussion of Piaget's stage theory of cognitive 
development is helpful here. Piaget posited a hierarchical 
theory that divides intellectual development into four major 
periods: 
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sensorimo tor stage , generally lasting from birth 
to two years and characterized by learning through active 
manipulation of the environment. 

2- The preoperat ional stage , lasting from ages two to 
seven and marked by the onset of symbolic thought. 

5- The concrete operations stage , lasting from ages 
seven to eleven, during which the child masters the concepts 
of identity, reversibility, and compensation. 

^- The formal op erations stai^e . which is characterized 
by the attainment of a high degree of abstract thinking 
(Ashton, 1975). 

The relevance for oral language proficiency assessment in 
ESL and bilingual classrooms is that interpretation of 
Piagetian theory has made distinct value judgments in favor of 
Western performance patterns. Often children have been 
diagnosed as cognitively deficient according to standardized 
measurements of middle-class, white American students. What 
is assumed as a cognitive deficiency may in reality be 
attributed to other causes, such as culturally-based 
beliefs. For instance an eight-year-old middle-class white 
child growing up in the United States may respond to the water 
and beaker experiment by noting the equality of liquid in both 
beakers, while a youngster in Senegal, West Africa, may insist 
that the water has changed and increased in quantity when 
poured into the tall, thin beoiker. Children of pottery-making 
families in Jalisco, Mexico, perform better on the 
conservation-of-quantiV experiment than their peers from non- 



pottery-making families. Research has also indicated that 
cultural beliefs may have a negative effect on cognitive 
development. Kohlberg (1968) found that among the Atayal, a 
Malaysian aboriginal group in Taiwan, conservation of a 
substance was acquired at the usual age of about seven or 
eight but then partially lost at ages eleven to fifteen, 
apparently due to conflict with adult beliefs about magic. 
These findings raise important issues concerning the validity 
of Piaget's theory, the nature of cultural and subcultural 
differences, and the diagnosis of language proficiency in ESL 
and bilingual children based on cognitive development theory. 

The point is made that cross-cultural research suggests a 
developmental lag for the acquisition of conservation in non- 
Western, non-industrialized cultures. What is not clear, 
however, is whether the lag may be due to the use of 
culturally inappropriate assessment of children's ability 
which would naturally be accompanied by lack of motivation or 
whether the lag may be due to real cognitive differences 
between cultures. The important point to remember is that a 
stuaent's age and developmental stage, cultural background and 
knowledge coupled with the impact of the student's immediate 
environment may, indeed, be reflected in that student's oral 
language proficiency skills. 
Cultural and environmental factors 

The conditions under which language is learned are 
largely culturally determined (Mattes & Omark, 1984). Forms 
of social interaction vary from culture to culture and 
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differences exist in the ways language is used for various 
purposes. Values, mores, and ways to interpret everyday 
experiences also vary. The cultural and environmental factors 
that make up a child's world have an impact on the child's 
capabilities to communicate and are important to con.-'ider in 
assessing oral language proficiency. 

Culture is defined as "the acquired patterns of thinking, 
feeling, and behaving that make life meaningful for a 
particular group of human beings" (Hallman, 1983). As we 
interact with others in our everyday lives we use our cultural 
knowledge as a guide for interpreting experiences. Much of 
everyday life is a series of unanticipated social occasions 
and although our culture does not provide a detailed map for 
all occasions, it does provide principles for interpreting 
them. 

Several questions about the child's culture or 
environment may be important to consider (Erickson & Omark, 
Eds. , 1981 ): 

1. Why have members of the cultural group left their 
homeland? 

2. Why have members of the cultural group settled in the 
local community? 

3. To what extent is poverty a factor in the cultural 
group? 

4. What is the typical family size? 

5. What roles are assigned to individual family members? 
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6. What cultural customs^ values, and beliefs are 
relevant to understanding children's behavior? 

7. What are the social functions and leisure activities 
in which members of the cultural group participate? 

8. How do members of the cultural group view the role 
and importance of education? 

9* What language(s) do the parents speak to each other? 
10. What language(s) do the parents speak to the child? 
11- What language(s) do the children use with each other? 

12. What language does the referred child prefer to use 
when playing with friends? 

13. Who takes care of the child after school? What 
language is used? 

14. Who lives in the home (parents, grandparents, etc.)? 
^3• How much time does each parent have to interact with 

the child? 

16. With whom does the child play when at home? 

17. What television programs are seen in each language? 

18. Are stories read to the child? In what language is 
the reading material written? 

19. What language is used in church services, if 
attended? 

20. What does the child do after school and on weekends? 

21. What responsibilities does the child have in the 
home? 

22. How is the child expected to act toward parents, 
teachers, and other adults? 
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23. In what cultural activities does the family 
participate? 

24. How do the parents expect adults to act toward the 
child? 

25. Are there any specific prohibitions in the everyday 
interactions between adults and children, for 
example, do not look adults in the eye when talking 
to them, do not pat children on the top of the head, 
do not ask children questions? 

26. How long has the family been in this country? 

27. How long has the family been in the local community? 

28. How much contact does the family have with the 
homeland? What kind of contact? 

29. Are the parents employed? If so, in what line of 
work? 

30. What are the parents' views on education for their 
child? 

Persona l and affective characteristics 

Regardless of age and developmental stage, cultural 
background and environmental circumstam;es , children's 
survival and developm^jnt depend on their capacity to recruit 
the invested attention of others to them (Kegan, 1932). For 
many children this is an inborn characteristic, for others it 
is a skill that must be developed and cultivated. In either 
case, it is important to consider qualities and 
characteristics about a child in order to evaluate the child's 
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oral language proficiency in the most effective and efficient 
way. 

In recent years, the study of children's motivation to 
achieve has attracted the attention of researchers from 
diverse areas. The subject has been discussed in terms such 
as locus of control, learned helplessness, values 
orientations, attribution theory, and positive and negative 
affect. Another research direction has been self efficacy, a 
concept that involves individuals' beliefs and judgments about 
their capabilities to carry out tasks (Bandura, 1977). 
Expectations of people of their potential for success are 
influenced by their own past experiences and efforts and 
determine whether they will initiate coping behavior, exp nd 
and sustain effort, and overcome obstacles. An example from 
children's literature better illustrates this theory: The 
Little Engine that v^'ould . Children who exemplify highly 
efficacious behavior are the classic models of success, while 
children with a lower sense of self efficacy often experience 
lack of success. These behaviors In both cases nay be 
reinforced. 

Awareness of the importance of selx efficacy attitudes is 
especially important regarding teaching limited English 
proficient children and evaluating their oral language 
proficiency stills. Individuals can b« trained to encourage 
the development of their own personal efficacy attitudes, some 
of which involve characteristics such as persistence in the 
face of failure, optimism, self discipline, goal setting, and 
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high self esteem. Nowhere are these characteristics more 
important than in a child's speaking ability where anxiety and 
fear of failure often counterbalance many positive factors. 

Information about these student variables, in addition to 
those mentioned previously, will contribute to a more valid 
rating of oral language proficiency. Other variables are 
grade, sex, religious preference, socioeconomic status, first 
language, other languages, Lau category, learning style, 
personality type, interests, hobbies, past times, family 
structure, birth order, and nonverbal habits such as gestures 
and nervousness. 

In summary, information for a total student profile forms 
the final complement of language hierarchy factors which may 
be used as an overall guide for assessing students' oral 
language proficiency skills. While it is imoossible to be 
familiar with all of the variables that affect a student's 
ability and motivation to speak, the more information teachers 
have and know about their students, the better the chances are 
not only for obtaining ratable language samples, but also for 
establishi/e and maintaining solid, positive rapport with 
their students. 
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The ACTFL Proficiency Guidelines 
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ACTFL 

PROFICIENCY GUIDELINES 



The 1986 proficiency guideiincs represent a hierarchy of global charaaenzauons of integrated performance 
in speaking, listening, reading and writing. Each description is a repinentaiive, not an exhausiive, sample 
of a panicuiar range of ability, and each level subsumes ail previous ieveis, moving from simple to complex 
in an "all-before-and-more'* fashion. 

Because tiiese guidelines idenufy stages of proficiency, as opfxiiicd to achic/ement, they are not intendea 
to measure what an individual has achieved through spedHc classroom in$tk*ucuon but rather to allow assess- 
ment of what an individual can and cannot do, regardless of where, when or how the language has been 
learned or acquired; thus, the words 'learned** and ^'acquired'* are used in iht broadest sense. These guidelines 
are not based on a particular linguistic theory or pedagogical method, sino; the guidelines are profiaency* 
based, as opposed to achievement-based, and are intended to be used tor global assessment. 

The 1986 guiaelines should not be considered the definitive version, since the construction and utilization 
of language proficiency guidelines is a dynamic, interaaive process. The academic sector, like the govern- 
ment seaor, will continue to refine and update the criteria periodically to reflect the needs of the users and 
the advances of the profession. In this vein, ACTFL owes a continuing debt to the creators of the 1982 pro- 
visional proficiency guidelines and, of course, to the members of the Interagency Language Roundtabie Testing 
Committee, \ht creators of the government's Language Skill Level Descnptions. 

ACTFL would like to thank the following individuals for thetr contributions on this current guidelines project: 

Heidi Byrnes 
James Child 
Nina Levinson 
Pardee Lowe. Jr. 
Seuchi Makino 
Irene Thompson 
A. Ronald Walton 



These proficiency guidelines are the product of grants from the U.S. Department oi Education 
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Generic Descriptions--Speaking 



Novice 

Novice-Low 

Novice-Mid 



Novice-High 



Intermedjate 



Intermediate- Low 



Intermediate-Mid 



Intermediate-High 



Advanced 



The Novire level is charactenzed by the ability to communicate minimally with learned material. 

Oral produaion consists of isolated words and perhaps a few high-frcqucnc>' phrases. Essentially no func- 
tional communicative ability. 

Oral production continues to consist of isolated words and learned phrases within very predictable areas of 
need, although quality is increased. Vocabulary is sufficient only for handling simple, elementary needs and 
expressing basic counesics. Utterances rarely consist of more than two or three words and show frequent long 
pauses and repetition of interlocutor's words. Speaker may have some difficulty producing even the simplest 
utterances. Some Novice-Mid speakers will be understood only with great difficulty. 

Able to satisfy partiaUy the requirements of basic communicative exchanges by relying heavily on learned ut- 
terances but occasionally expanding these through simple recombinauons of their elements. Can ask questions 
or make statemcnu involving learned material. Shows signs of spontaneity although this falls shon of real 
autonomy of expression. Speech continues to consist of learned utterances rather than of pcnonalized, situa- 
tionaily adapted ones. Vocabulary centers on areas such as basic objects, places, ^nd most common kinship 
terms. Pronunciation may still be strongly influenced by first language. Errors arc frequent and, in spite of 
repetition, some Novice-High speaken will have difficulty being understood even by sympathetic interlocutors. 

The Intermediate level is charaaerized by the speaker's ability to: 

—create with the language by combmmg and recombining learned elemenu, though primarily in a reacnve mode; 
— imtiate, minimally sustain, and close in a simple way basic communicauve tasks; and 
— asjc and answer questions. 

Able to handle successfully a limited number of interaaive, task-oriented and social situations. Can ask and 
answer ques^ons, initiate and respond to simple statements and maintain face-to-face conversation, although 
in a highly restriaed manner and with much linguistic inaccuracy. Within these limitauons, can perform such 
tasks as introducing self, ordering a meal, asking direaions, and making purchases. Vocabulary is adequate 
to express only the most elementary needs. Strong interference from native language may occur. Misunderstand- 
ings frequently arise, but with repetition, the Intermediate-Low speaker can generally be understood by sym- 
pathetic interlocutors. 

Able to handle successfully a variety of uncomplicated, basic and communicative tasks and soaal situations. 
Can talk simply about self and family members. Can ask and answer questions and partiapate m simple con- 
versations on topics beyond the most immediate needs; e.g., personal history and leisure time activities. Ut- 
terance length increases slightly, but speech may continue to be charactenzed by frequent long pauses, since 
the smooth incorporation of tven basic conversational strategics is often hindered as the speaker struggles 
to create aopropnate language forms. Pronunaation may continue to be strongly mfiuenced bv first language 
and fiuency may still be strained. Although misunderstandings still arise, the Intermediatc-Mid speaker can 
generally be unde.stood by sympathetic interlocutors. 

Able to handle successfully most uncomplicated communicative tasks and soaal situations. Can initiate, sus- 
tain, and close a general conversation with a number of strategies appropriate to a range of arcumstances 
and topics, but errors are evident. Limited vocabulary still necessitates hesitation and may bring about slightly 
unexpected circumlocution. There is emerging evidence of conneaed discourse, particularly for simple narra- 
tion ^nd/orjJ«cnption. The Intermediate-High spcalier can generally by understood even by interlocutors 
«Gt ac.;u3:cu.eu to uMung with speakers at tnis ievei, out repetiticn may still be required. 

The Advanced level is characterized by the speaker's ability to: 
—converse in a clearly participatory fashion; 

—initiate, sustain, and bring to closure a wide variety of communicative tasks, including those that require 
an increased abihty to convey meaning with diverse language strategies due to a complication or an unforeseen 
ium of events: 

—satisfy the requirements of school and work situations; and 
—narrate and descnbe with paragraph-length connected discourse. 



ERIC 



( v> 



69 



Advanced 



Advanced-Ptus 



Superior 



Superior 



Able to satisfy the requirements of everyday situations and routine school and work requirements. Can han- 
dle with confidence but not with facility complicated tasks and social situations, such as elaborating, com- 
plaining, and apologizing- Can narrate and describe with some details, linking sentences together smoothly. 
Can communicate facts and talk casually about topics of current public and personal interest, using general 
vocabulary. Shortcomings can often be smoothed over by communicative strategies, such as pause nUers. 
stalling devices, and different rates of speech. Circumlocution which arises from vocabular> or syntactic 
limitations very often is quite successful, though some groping for words may still be evident. The Advanced- 
level speaker can be understood without difficulty by native interlocutors. 

Able to satisfy the requirements of a broad variety of everyday, school, and work situations. Can discuss 
concrete topics relating to particular interests and special fields of competence. There is emerging evidence 
of ability to support opinions, explain in detail, and hypothesize. The Advanced-Plus speaker often shows 
a well developed abiUty to compensate for an imperfea grasp of some forms wuh confident use of com- 
municative strategies, such as paraphrasing and circumlocution. Differentiated vocabulary and intonation 
arc effectively used to communicate fine shades of jneaning. The Advanced-Plus speaker often shows 
remarkable fluency and ease of speech but under the demands of Superior-level, complex tasks, language 
may break down or prove inadequate. 

The Superior level is characterized by the speaker's ability to: 

^partidpate effectively in most formal and informal conversations on practical, social, professional, and 
abstract topics; and 

^suppon opinions and hypothesize using native-like discourse strategies. 

Able to speak the language with sufficient accuracy to participate effectively in most formal and informal 
conversations on practical, sodal, professional, and abstraa topics. Can discuss special fields of competence 
and interest with ease. Can support opinions and hypothesize, but may not be able to tailor language to 
audience or discuss in depth highly abstract or unfamiliar topics. Usually the Superior level speaker is only 
partially familiar with regional or other dialectical variants. The Supenor level speaker commands a wide 
variety of interactive strategies and shows good awareness of discourse strategies. The latter involves the 
ability to distinguish main ideas from supporting information through syntactic, lexical and suprasegmental 
features (pitch, stress, intonation). Sporadic errors may occur, panicularly in low-frequency siruaures and 
some complex high-frequency structures more common to formal writing, but no patterns of error are evi- 
dent. Errors do not disturb th<r native speaker or interfere with communication. 



Generic Descriptions-Listening 

These guidelines assume tha: all listening tasks take place in an authentic environment at a normal rate of speech using standard 
or near*siandard norms. 



Novice-Low 



Novice-Mid 



Novice-High 



Intermediate- Low 



Understanding ts limited to occasional isolated words, such as cognate, borrowed words, and high-frequencv 
social conventions. Essentially no ability to comprehend even shon utterances. 

Able to understand some short, learned utterances, particularly where context strongly supports understand* 
ing and speech is cieariy audible. Comprehends some words and phrases from simple questions, statements, 
high-frequency commands and counesy formulae about topics that refer to basic personal information or 
the immediate physical setting. The listener requires long pauses for assimilation and periodically requests 
repetition and/or a slower rate of speech. 

Able to understand shon, learned utterances and some sentence-length utterances, panicularly where con- 
text strongly suppons understanding and speech is cieariy audible. Comprehends words and phrases from 
simple questions, statements, high-frequency commands and courtesy formulae. May require repetition, 
rephrasing and/or a slowed rate of speech for comprehension. 

Able to undertand sentence-length utterances which consist of recombinations of learned elements in ^ limited 
number of content areas, particularly if strongly supported by the situational context. Conienc r „ ers to 
basic personal background and needs, social conventions and routine tasks, such as getting meats and receiving 
simple instructions and directioL^. Listening tasks pertain primarily to spontaneous face-to-face conversa- 
tions. Understanding is often uneven; repetition and rewording may be necessary Misunderstandings m 
both main ideas and details arise frequently. 



ERLC 



70 



Inicrmediatc-Mid Able to understand sentence-length utterances which consut of recombinations or learned utterances on a vaneiy 
of topics. Conicnt continues to refer primarily to basic personal background and needs, social conventions 
and ^me>vhat more complex tasks, such as lodging, transportation, and shopping. Additional content areas 
include some personal interests and activities, and a greater diversity of instructions and directions. Listening 
tasks not only pertain to spontaneous facc-to-face conversations but also to short routine telephone consersa- 
tions and some deliberaie speech, such as simple announcements and reports over tne media. Understanding 
continues to be uneven. 



'ntermediate-Hish 



Advanced 



Able to sustain undentanding over longer stretches of connected discourse on a number of topics pertaining 
to different times and places; however, undentanding is inconsistent due to failure to grasp mam ideas and/ or 
details. Thus, while topics do not differ significantly from those of an Advanced level listener, comprehension 
IS less in quantity and poorer in quality. 

Able to understand main ideas and most details of conneaed discourse^n a vanety of top'cs beyond the im- 
mediacy of the situation. Comprehension may be uneven due to a vanety of linguistic and extralinguistic fac- 
'ors, among which topic familiarity is very prominent. These texts frequently involve description and narra- 
lion in different time frames or aspects, such as present, nonpast, habitual, or imperfeaive. Texts may include 
interviews, short leaures on familiar topics, and news items and reports pnmanly dealing with faaual infor- 
mation. Listener is aware of cohesive devices but may not be able to use them to follow the sequence of thought 
in an oral text. 



Advanced-Plus 



Supenor 



Distinguished 



Able to understand the main ideas of most speech in a standard dialea; however, the listener may not be 
able to sustain comprehension m extended discourse which is proposiuonaily and linguistically complex. Listener 
shows an emerging awareness of culturally implied meanings beyond the surface meanings of the text but may 
fail to grasp sodocultural nuances of the message. 

Able to understand the mam ideas of all speech in a standard dialect, including lechnical discussion in a field 
of spcdaliiaiion. Can follow the essentiais-of extended discourse which is propositionally and linguistically 
complex, as in academic/professional settings, in lectures, speeches, and reports. Listener shows some ap- 
preciation of aesthetic norms of target language, of idioms, coUoquialisms, and register shifting. Able to make 
inferences within the cultural framework of the target language. Undentanding is aided by an awareness of 
thfe underlying organizational structure of the oral text and includes sensiovity for its soaal and cultural references 
and Its affective ovenones. Rarely misunderstands but may not undentand excessively rapid, highly colloquial 
speech or speech that has strong cultural references. 

Able to undentand all forms and styles of speech pertinent to penonal, social and professional needs tailored 
to different audiences. Shows strong sensitivity to soaal and cultural references and aesthetic norms bv pro- 
cessing language from with: . the cultural framework. Texts include theater plays, screen produaions, editonals. 
symposia, academic debates, public policy statements, literary readings, and most jokes and puns. Mav have 
difficulty with some dialeas and slang. 



Generic Descriptions-Reading 

These guidelines assume all reading texts to be authentic and legible. 



Novice-Low 
Novice-Mid 

Novice-High 



Able occasionally to identify isolated words and/or major phiascs when strongly supported by context. 

Able to recognize the symbols of an alphabetic and/or syllabic wnting system and/or a limited number of 
charaaen in a system that uses charaaen. The reader can identify an increasing number of highly contex- 
tualued words and/or phrases including cognates and borrowed words, where appropnate. Matenal undcntood 
rarely exceeds a single phrase at a time, and rereading may be required. 

Has sufficient control of the wnting system to interpret w ten language in areas of practical need. Where 
vocabular>' has been learned, can read for mstruaional and direaional purposes standardized messages phrases 
or expressions, such as some items on menus, schedules, timetables, maps, and iigns. At times, but not on 
a consistent basis, the Novice-High level reader may be able to derive meaning from material at a sii8htK 
higher level where comext and/or e\tralinguistic background knowledge are supportive 
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lnterniedtate*Low Able to undenund main ideas and/or some facts from the simplest conneaed texts dealing with basic per* 
sonal and socul needs. Such texts are linguistically noncomplex and have a clear underlying internal structure, 
for example chronological sequenang. They impart basic mformation about which the reader has to make 
only m nimal suppositions or to which the reader bnngs personal interest and/or knowledge. Examples in- 
dude messages wnh soaai purposes or information for the widest possible audience, such as public an- 
nouncements and short, straightforward instructions dealing with public life. Some misunderstandings will occur. 

Able to read consistently with increased undentanding simple conneaed texts dealing wirh a vanety of basic 
and social needs. Such texts are still linguisucally noncomplex and have a clear underlying internal structure. 
They impan basic information about which the reader has to make minimal suppositions and to which the 
reader bnngs personal interest and/or knowledge. Examples may include short! straightforward descnptions 
of persons, places, and things written for a wide audience. 

Intermediate— High Able to read consistently with full undentanding simple conneaed texts dealing with baste personal and social 
needs about which the reader has personal interen and/or knowledge. Can get some main ideas and informa- 
tion from texts at the next higher level featuring description and narration. Stniaural complexity may interfere 
with comprehension; for example, basic grammatical relations may be misinterpreted and temporal references 
may rdy primarily on lexical items. Has some difficulty with the cohesive faaors m discourse, such as mat- 
ching pronouns with referenu. While texts do not differ significantly from those at the Advanced levels com- 
prehension is less consistent. May have to read material several times for understanding. 

Advanced Able to read somewhat longer prose of several paragraphs in length, panicuiarly if presented with a clear 

underlying struaure. The prose is predominantly in familar sentence patterns. Reader gets the main ideas and 
facts and misses some details. Comprehension derives not only from situational and subjea matter knowledge 
but from increasing control of the language. Texts at this level include descnpuons and narrations such as 
simple short stones, news items, bibliographical information, sodal notices, personal correspondence, rouunized 
business leners and simple technical material wntten for the general reader. 

Advanced-Plus Able to follow essential points of written discourse at the Superior level in areas of special interest or knowledge. 

Able to understand parts of texts which are concepmally abstraa and linguistically complex, and/or texts which 
treat unfamiliar topics and situations, as weil as some texu which involve aspects of target-language culture. 
Able to comprehend the faas io make appropriate inferences. An emerging awareness of the aestheuc proper- 
ties of language and of its literary styles permits comprehension of a wider vanety of texts, including literary. 
Misunderstandings may occur, 

Supenor Able to read with almost complete comprehension and at normal speed expository prose on unfamiliar sud- 

jects and a vanety of literary texts. Reading ability is not dependent on subjea matter knowledge, although 
the reader is not expeaed to comprehend thoroughly texts which are highly dependent on knowledge of the 
target culture. Reads easily for pleasure. Supenor-level texts feature hypotheses, argumentation and supported 
opinions and include grammatical patterns and vocabulary ordinarily encountered m academic/ professional 
reading. At this level, due to the control of general vocabulary and struaure, the reader is almost always able 
to match the meanings derived from extralinguisttc knowledge with meanings derived from knowledge of the 
language, allowing for smooth and efficient reading of diverse texts. Occasional misunderstandings may srill 
occur; for example, the reader may experience some difficulty with unusually complex struaures and low* 
frequency idioms. At the Superior level the reader can match strategies, top-down or bottom-up, which are 
most appropriate :o the text. (Top-down strategies rely on real-world knowledge and prediaion based on genre 
and organizational scheme of the text. Bottom-up strategies rely on aaual linguistic knowledge.) Matenal at 
this level will include a vanety of literary texts, editonals, correspondence, general reports and technical matenal 
in professional fields. Rereading is rarely necessary, and misreading is rare. 

Distmguished Able to read fluently and accurately most styles and forms of the language peninent to academic and profes- 

sional needs. Able to relate inferences in the text to real-world knowledge and understand almost all soao- 
linguistic and cultural references by processing language from within the cultural framework. Able to under- 
stand a wnter's use of nuance and subtlety. Can readily follow unprediaable turns of thought and author 
intent in such matenals as sophisticated editonals, specialized journal articles, and literary texts such as novels, 
plays, poems, as well as in any subject matter area directed to the general reader 



Intermediate-Mid 

t 




Generic Descriptions-Writing 

Novice-Low Able to form some leiten in an alphabetic system. In languages whose wnting systems use syllabanes or 

charaaers, wnter is able to both copy and produce the basic strokes. Can produce romanization of isolated 
charaaers, where applicable. 

4 7o 



72 



Novice-Mid Able to copy or transcnbe familiar words or phrases and reproduce some from memory. No praaical com- 

municative wntmg skills. 

Novice*High Able to wnte simple fi/ied expressions and limited memonzed material and some recombinations thereof. Can 

supply tnformauon on simple fonns and documents. Can write names, numbers, dates, own nationahty, and 
other simple autobiographical information as well as some short phrases and simple lisu. Can wnte all the 
symbols in an alpahbetic or syllabic system or 50-100 characters or compounds in a character writing system. 
Spelling and representation of symbols (letters, syllables, characters) may be partially correa. ' 

Intermediate-Low Abie to meet limited practical wntmg needs. Can wnte short messages, postcards, and take down simple notes, 
such as telephone messages. Can create statements or questions within the scope of limited language expenence. 
Material produced consists of recombinations of learned vocabulary and structures into simple sentences on 
very familiar topia. Language is inadequate to express in wnting anything but elementary needs. Frequent 
erron in grammar, vocabulary, punauauon« spelling and in formauon of nonalphabeuc symbols, but wnting^ 
can be understood by natives used to the writing of nonnatives. 



Intermediate-Mid Able to meet a number of practical writing needs. Can write shon« simple letters. Content involves personal 
preferences, daily routine, everyday events, and other topics grounded in personal experience. Can express 
present ome or « least one other tune frame or aspect consistently, e.gM nonpast, habitual, imperfecuve. Evidence 
of control of the syntax of noncomplex sentences and basic infleaional morphology, such as declensions and 
conjugation. Wnung tends to be a loose colleaion of sentences or sentence fragments on a given topic and 
provides linle evidence of conscious organization. Can be understood by natives used to the wriung of nonnauves. 



latermediate-High Able to meet most praaical wnnng needs and limited social demands. Can take notes in some detail on familiar 
topics and respond in writing to personal questions. Can write simple letters, bnef synopses and paraphrases, 
summanes of biographical data, work and school experience. In those languages relying pnmanly on content 
words and time expressions to express time, tense, or.aspea, some precision is displayed: where tense and/ or 
aspea is expressed through verbal infleaion, forms are produced rather consistently, but not always accurate- 
ly. An ability to describe and narrate in paragraphs is emerging. Rarely uses basic cohesive elements, such 
as pronominal substituuons or synonyms in wnnen discourse. Wriung, though faulty, is generally comprehensible 
to natives used to (he wntmg of nonnatives. 

Ad%anced Able to wnte routine social conrespondence and join sentences in simple discourse of at least several paragraphs 

in length on familiar topics. Can wnte simple soaal correspondence, take notes, wnte cohesive summaries 
and resumes, as well as narratives and descnptions of a faauai nature. Has sufficient wntmg \ocabuiar\ (o 
express self simply with some circumlocution. May still make errors in punctuation, spelling, or the formation 
ot nonalphabetic symbols. Good control of t! 3 morphology and the most frequently used syntactic :»tructures. 
e.g.. common word order patterns, coordination, subordination, but makes frequent errors in produang complex 
sentences. Uses a limited number of cohesive devices, such as pronouns, accurately. Wnting may resemble 
literal translations from (he native language, but a sense of organization (rhetorical structure) ts emerging. 
Wnting IS understandable to natives not used to the wnting of nonnatives. 

Advanced-Plus Abie to write about a vanety of topics with significant precision and in detail. Can wnte most social and infor- 

mal business correspondence. Can describe and narrate personal experiences fully but has difficulty suppon- 
ing points of view in written discourse. Can wnte about the concrete aspects of topics relating to panicular 
interests and special fields of competence. Often shows remarkable fluency and ease of expression, but under 
time constraints and pressure wntmg may be inaccurate. Generally strong in either grammar or vocabulary, 
but not in both. Weakness and unevenness m one of the roregomg or in spelling or character wnting forma- 
tion may result in occasional miscommunicatton. Some misuse of vocabulary may Siill be evident. Style mav 
still be obviously foreign. 

Able to express self effectively in most formal and informal wnting on practical, social and professional topics 
Can wnte most types of correspondence, such as memos as well as social and business letters, and short research 
papers and statements ol position in areas of special interest or in special fields. Good control ol a t'ull range 
of structures spelling or nonalphabetic symbol production, and a wide general vocabulary allow the wnter 
to hypothesize and present arguments or points of view accurately and effeaively. An underlying organiza. 
tion. such as chronological ordenng, logical ordering, cause and effea, comparison, and thematic develop- 
ment IS strongly evident, although not thoroughly executed and/or not totally retlecting target language pat- 
terns. Although sensitive to differences in formal and informal style, still may not tailor wntmg precisely to 
a vanety of purposes and/or readers. En-ors in wntmg rarely disturb natives or cause miscommunication. 

• 77 
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Appendix 2 
Additional Test Descriptions 
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1* The Bahia Oral Language Test (BOLT), available in 

English and Spanish, requires students to produce 
grammatical structures in the language tested* The 
structures are elicited by means of student responses to 
questions and pictures (a city scene, a family at home, a 
cat chased into a tree by a dog). The test is scored 
according to whether or not a particular grammatical item, 
such as an irregular|*or regular plural, a possessive form, 
a particular verb tense, is used correctly* 
2. The Bilingual Syntax Measure (BSM), available in 

several languages, is also a test of language 
structures. As in the BOLT, the child's responses are 
elicited by questions about cartoon-type pictures (fat and 
thin people, a boat with a fisherman, a king about to 
eat). The test is scored according to whether the 
expected grammatical element is "well-formed," or correct* 
3* The 3ili..gual Inventory of Natural Languages (BINL), 

available in English and Spanish, requires students to 
answer questions about photographs of neighborhood, home, 
and school activities. Students • responses are recorded 
and the language samples are scored according to these 
criteria: the number of words used; completeness of 
sentences; the use of specific grammatical forms such as 
articles, possessive and demonstrative pronouns, 
objectives and adverbs; and the use of subordinate 
clauses. 
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The Language Assessment Battery (LAB), developed by 
the New York City Board of Education and available in 
English and Spanish, is comprised of tests of listening, 
reading, writing, and speaking. In the speaking section, 
students are expected to answer everyday questions, name 
body parts, and complete sentences on the same model as 
that given by the tester. The speaking test is scored 
according to the various i ammatical forms used. 

The Language Assessment Scale (LAS), available in 
English and Spanish, contains measures of phonemic and 
grammatical production and requires the student to retell 
a story. The story retelling task is then scored 
according to a rating scale. 

P-rating system. 

This system is based on the premise that the teacher 
is the single most valuable source of information about 
student language proficiency. Using guidelines drafted 
for this system in the areas of accent, grammar, 
vocabulary, fluency, and comprehension the teacher can 
relatively quickly evaluate students • oral language 
proficiency. This system was based on the Foreign Service 
Institute (FSI) rating scale and is an overall judgment of 
speaking ability. 
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